Your question assumes two things and these make your question loaded in favour of your own personal creed.
1 We do not "choose" to put faith in the Bible, but we do put faith in Him who is the substance of our faith. Jesus Christ. [2 Tim 1:13] The Bible is an extension of such faith but is not the substance of it. The Bible does not save nor does a study of it do so. Only Jesus does. [Jo 5:39]
As Christians we accept the fact that none of us has the Absolute Interpretation of Scripture, hence we accept a variety of interpretive ministries in those parts of Scripture that are not contingent on salvation, although, on those parts that are there is a remarkable and harmonious amity.
We believe, despite its problems, textual, and polemical, that the Bible contains the Word of God, and is inspired and is profitable for teaching, reproof, correction, and training in righteousness. [2 Tim 3:16] But nobody becomes righteous by either reading or studying the Bible as if it somehow possesses Talmudic complexities that need to be divined. Righteousness is a gift [Rom 5:17] that is miraculously given to believers who have faith in Jesus Christ. [Ro 3:22]
2 You further imply that instead, believers ought to put their faith in "The Holy Spirit, who is the Son of God, and the Holy One of Israel". This sounds like a complicated system of Oneness Theology which sees The Father, The Son and the Holy Spirit as one person.
I do not intend to go down this road, but suffice it to say, that faith in Christ implies faith in the Father and the Holy Spirit equally, though Scripture portrays them as separate Persons, or centers of consciousness. We have faith in the Father as the Originator of salvation, in Christ as the Means of it, and the Holy Spirit as the Enlightener of salvation. There is no rivalry for our faith in heaven.